Quantum lower bound for sorting Q 
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We prove that Q(nlogn) comparisons are necessary for any quantum algorithm that sorts 
n numbers with high success probability and uses only comparisons. If no error is allowed, 
Q\ ' at least 0.110nlog 2 n — 0.067n + 0(1) comparisons must be made. The previous known 
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lower bound is Q(n). 
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1 Introduction 

The speedups of quantum algorithms over classical algorithms have been the main reason 
for current interests in quantum computation. Although dramatic speedups may be pos- 
sible, for example, Shor's [16] algorithms for factoring and for finding discrete logarithms, 



the hunt for provable speedups has been successful only in very restricted models, such as 
the decision tree model. 

In the decision tree model, the inputs x%, X2, • ■ ■ ,x n are known only to an oracle, and 
the only way that the algorithm can access the inputs is by asking the oracle questions 
of the type "xj =?". The complexity measurement is the number of such queries. Many 
problems that allow provable quantum speedups can be formulated in this model. For 
example, Grover's |l4| algorithm for deciding i given the input e^, i.e., the re-bits binary 
string that has a 1 in the ith position and elsewhere, makes 0{^fn) queries, while any 
classical algorithm needs O(re) queries. Grover's algorithm has been the core quantum 
ingredient in the fast quantum decision tree algorithms for several other problems. Some 
examples are, the algorithm of Boyer et al. || for computing the OR of re Boolean inputs 
in 0(y/n) queries, the algorithm of Durr and H0yer JO]] for finding the minimum of n 
numbers in 0(y/n) queries, and, more recently, the algorithm of Buhrman et al. |J for 
solving the Element Distinctness problem in 0(n 3 ' 4 log re) queries. 

The optimality of Grover's algorithm is implied by the earlier result of Bennett et al. 
||. Beals et al. Q and Ambainis || prove some powerful general lower bounds. Notably 
not all problems allow quantum speedups. The PARITY function is an example. 

How fast can quantum computers sort? This is probably among the most natural 
questions to ask about the power of quantum computers. It is very natural to study the 
comparison-based sorting in the decision tree model. This is because the minimum number 
of comparisons needed to sort n numbers is just the same as the decision tree complexity 
of the following problem: given the comparison matrix of n numbers, output the order 
of these numbers. Without loss of generality, we assume that the comparison operator is 

A straightforward information theoretical argument gives the n log 2 n classical lower 
bound, which is matched by simple sorting algorithms such as Insertion Sort with an 
0(n) additive term. Using the quantum algorithm for searching an element in a sorted 
list by Farhi et al.[12] as a subroutine in Insertion Sort, a quantum computer needs only 



compare 0.526ralog 2 re + 0{n) times. However, the hope of improving this upper bound 
asymptotically by improving the upper bound for the ordered search is made impossible 



because of the ri(logn) lower bound for the latter problem due to Ambainis [2J. 

Ambainis' lower bound proof for the ordered search does not seem to apply to the 
sorting problem. However, a straightforward application of the same author's general 
lower bound technique Q gives an Q(n) lower bound. In this paper, we improve the 
lower bound to Q(nlogn). This means that the best comparison-based quantum sorting 
algorithm can be at most a constant time faster than the best classical algorithm. Our 
approach is similar to that taken by Ffoyer and Nerbeek [ffq] in improving the lower bound 
for the ordered search by a constant factor. That is, we use the weighted version of 
the adversary idea of Ambainis H with a carefully chosen probabilistic distribution of 
adversary input pairs, and the lower bound finally relies on a property of the Hilbert 
matrix. 

In the next section we give a formal definition of the quantum decision tree model. 
After introducing some notations, we give a proof overview. The complete proof of the 
main lemma is presented in Section |3|, which is followed by the section for open problems. 



2 Notations and overview 

2.1 The model 

Following the paper of Beals et al. Q, we give a formal definition of the standard quantum 
decision tree model for computing a function / : {0, l} m — ► {0, 1} . 

The quantum algorithm works in the Hilbert space 

span{|s,6, c) : s G Z m , b G {0, 1}, c G {0, 1} W , for some integer w > 0}. 

An oracle holds the input x = xqX\ ■ ■ ■ x m -\ G {0, l} m , which is not known to the algorithm 
directly. Recall that in the classical decision tree model, the input bit X{ is returned to 
the algorithm if the index i is presented to the oracle. In the quantum setting, due to the 
requirement of being unitary for all quantum operations, x« is XOR-ed with another bit 
provided by the algorithm. Mathematically, the algorithm "reads" the input through the 
oracle gate, which is a unitary transformation that depends on x and works on each base 
vector \s,b, c) as follows: 

O x \s,b, c) = \s,b(B Xg,c). 

It is easy to verify that with ^ = 4j(|0) ± |1)), 

O x \s,y-,c) = (-ir°\s,y-,c), 



and, 

O x \s,$> + , c) = |s,* + ,c). 

A quantum decision tree algorithm that makes T queries is the application of a sequence 
of unitary transformations on the initial state | ) : 

U T O x U T -iO x ---U 1 O x U \t}. 

For all t, < t < T, we write 

<$ :=U t O x ---U \t). 

We say that the quantum algorithm computes / with the error probability bounded by 
e, for some constant e such that < e < 1/2, if there is a measurement M, such that for 

(T) 

any input x, when M is applied to <p x , the probability of observing f(x) is no less than 
1-e. 

2.2 More notations 

For our lower bound purpose, it suffices to assume that xq,x±, • • • ,x n -±, the n numbers 
to be sorted, correspond to some permutation a of {0, 1, • • • , n — 1}, i.e., x« = cr(i), for 
all < i < n — 1. The input to the quantum decision tree algorithm is the comparison 
matrix M a G M n , i.e., for all i and j, < i,j < n — 1, 

I otherwise. 

For the simplicity of notations, when the subscript M a is needed, we use a instead. The 
Hilbert space of the algorithm is now 

H := span{\i,j, b, c) : < i, j < n - 1, b G {0,1}, c G {0, 1} W , for some w > 0}. 

The oracle gate that corresponds to the input a works as follows: 

O a \i,j,b,c) = \i,j,b®(M ff ) itj ,c). 

For all i and j, < i,j < n — 1, let Pjj be projection from H to the subspace 

span{|i,j,*-,c),|i,i,*-,c) :ce{0,lf}. 

For any permutation a, and any k, d G Z with < A; < n — 2 and 1 < d < n — fe — 1, we 
define a new permutation 



Note that if r = a^ k ' d \ we have 



r 1 {i + d) i = k, 

T- l {i-l) k + l<i<k + d, 

r _1 (i) otherwise. 

Also note that M a and M T differ on only the following pairs of indices 

{a- l (k),a- l {k + i)} = {r" 1 ^ + d),T~\k + i - 1)}, 

for all i such that 1 < i < d. The weight function w(a, r) is defined for every pair of 
permutations: 

1/d if r = <j( k ' d \ for some fc and d, 
w(a, t) := < such that < k < n — 2 and l<d<n — k — 1, 

otherwise. 

Define H n := £? =1 1/i 



2.3 Proof overview 



Now we describe the main idea of the adversary technique. For any pair of the inputs 

(a;, y) such that f(x) ^ f(y), any algorithm that computes / with high success probability 

(T) (T) 

must separate the two final vectors </4 and (fy y far apart. However, it is hard for 

the algorithm to distinguish x and y if they are very similar. Therefore, if there is a 

probabilistic distribution of close pairs so that on average the algorithm can only separate 

the corresponding vectors by a little amount on each step, then we can argue that the 

algorithm needs many steps. The quantity \{<j) x \4>y )\ is used to measure how close the 

two vectors are. 

The follow quantity is an indication of the algorithm's progress: 



s t :=^2 w (a,T) 



KW\Ath 



The idea behind the choice of w(a, r) is that, for any permutation a, these permutations 
r obtained from a by rotating some d consecutive elements are close to a. Moreover, 
the smaller d is, the harder for the algorithm to distinguished them. Therefore w((j,t) is 
proportional to 1/d. 

Since the algorithm starts with the same initial state regardless of the input, by usual 
calculation we have, 



Lemma 2.1 sq = n\(nH n ^i — n + 1). 

It is a well known fact that if an algorithm computes a function / with the error 
probability bounded by e, then for any pair of inputs x and y such that f{x) / f(y), 

K# ) i4 T) )i<2V<r^). 

See, for example, the paper of Ambainis for a proof. Henceforth, 



Lemma 2.2 st < 2yje(l — e)so- 

Our main lemma says that any algorithm can make only a little bit of progress in 
decreasing st on each step: 

Lemma 2.3 (Main Lemma) |s i+ i — st\ < 2irn\, for all < t < T — 1. 

Since 

r-i 

(1 - 2^(1 -e))s < \st ~ sol < ^2 \ St + 1 ~ s °l' 

by the previous lemmas, we obtain our main theorem: 

Theorem 2.4 (Main Theorem) Any quantum sorting algorithm with the error proba- 
bility bounded by e must compare no less than 



^-^ — -{nH n ^ - n + 1) = ft(nlogn) 

2-7T 

times. 

Setting e = 0, we obtain 

Corollary 2.5 Any error-less quantum sorting algorithm must compare at least 
— nlnn -n + 0(l) « 0.110nlog 2 n - 0.067n + O(l) 

27T 27T 

times, where Ce = 0.57721566 ■ ■ ■ is the Euler-Mascheroni Constant. 

Let A = [afc,z]i<fc,z<oo be the Hilbert matrix with a^i = l/{k + 1 — 1), and ||| - 1|| 2 be the 
spectral norm, i.e., for any complex matrix M £ M m , 

\\M\h:= max \\Mx\\ 2 . 

x£C m ,\\x\\ 2 =l 

Our proof for the Main Lemma relies on the following property of the Hilbert matrix: 
Lemma 2.6 III ^4 III 2 = vr. 



Choi [10] has an elegant proof for this lemma. 



3 Proof of the Main Lemma 



Proof. [Lemma 2J3] For each individual pair (ct,t), where r = cr' ' ', by the definitions 



of 4> a and 4> T , we have 



,(t+i), ,(t+i)\ 



a^: 



Ut+ilQ^ - O t ^) + U t+x O T c0 



C/mO,^)-^'!^; 



By the properties of the inner product and that Ut+\ is unitary, the above expressions are 
simplified to 

(1) 



((0 T -!)<$) \<$>) 



The effects of O a and O t cancel out on most base vectors, except for these \i,j, * , c) 
such that (M a )ij ^ (M T )ij. Therefore Eq. [I] is bounded from the above by 



2Y\{P 



i=l 



(j- l {k),a- l {k + i)^ l^ T ' 



By the Cauchy-Schwarz inequality, this expression can be further upper-bounded by 



2 ^\ P a- 1 {k),<j~ 1 {k + i) <l) " " P <j~ 1 {k),a- 1 {k + i) <l) 



1=1 



fc w 



(2) 



Now we are ready to bound At := |«t+i ~~ s t\- By definitions and pulling summations 
out of the absolute value, we obtain 



n— 2 n—k—1 



^£££i 



r-v'Si 



£V«',L,: 



(3) 



cr k=0 d=l 

Plug in the upper bound of Eq. 0, this is then upper-bounded by 

n—2n~k—l d ^ 

2 Yj12 Yl Yldlro-'Hkla-Hk + i)^ ' P a- l {k),<j~ l {k + i)K^) 

a k=0 d=l i=l 

By reordering the terms of the summation and applying the Cauchy-Schwarz inequality, 
this is further upper-bounded by 



-l „ d 



n—d—l 



11/ _L -. U< lb Uj _L q 111 Ui J. 

2 12d^\Y Y Va^ik^.a^ik + i)^ | \ S Yl \ P a- l (k),(j- l (k + i)K^) 

d=l 1=1 \ cr fc=0 \ cr fc=0 



ra— d— 1 



(4) 



Let a = [ai\i<i< n -l G C™ be a column vector with 



Clearly, 



and, 



a,- :- 



ra— i— 1 



(*) 



\ 2 12 fV-^o^H'-h)^ 



1 



n— ci— 1 



E E K 



<T fc=0 






< Oi 



n—d—l 






n—d—l 



(*) 



\ T fc=0 



< Od-i+1- 



Let K n _i = [Kki]i<k,i<n-i £ M n _i be a Hankel matrix with 



«W 



l/(/c + Z - 1) fc + /<n, 
otherwise. 



Now Eq. || can be upper-bounded by 

n— 1 d 

2 ^ ^ -jaiCid-i+i = 2a T K n - 1 a. 



d=l i=l 



fc W 



Since every <p a is a unit vector, we have 

n— 1 n— i— 1 



kill 



= EE E II- F 5t-1(0,<t-1(I+*)*»^ 

1=1 cr (=0 

n— 2 n—l—l 
= 1212 12 \\ P <r-Hl)jT-HM 

a 1=0 i=l 

< n!. 



(*)||2 



(*)||2 



(5) 



Clearly ||if Tl _i|||2 < ||-A|2 = tt> by Lemma ^1| Applying the Cauchy-Schwarz inequality 
and by the definition of the spectral norm, we obtain the desired upper bound: 



\st+i ~ s t \ < 2||a||!|.K n _i|||2 < 27m!. 



4 Open problems 

The result of Grigoriev et al. |ljj implies that if only comparisons are allowed, the random- 
ized decision tree complexity of Element Distinctness has the same O(nlogn) lower bound 
as the sorting problem. Interestingly, their quantum complexities differ dramatically: the 
quantum algorithm for Element Distinctness due to Buhrman et al. || compares only 
0(n 3 ' log n) times. It would be interesting to improve the current trivial lower bound of 
0(i/n) for Element Distinctness. 

The decision tree complexity of nontrivial monotone graph properties has been a classi- 
cal subject. Recently, Yao Jl7[ proves an Q(n 2 > 3 ) lower bound for the quantum complexity 
of every nontrivial monotone graph property. It is reasonable to conjecture that the cor- 
rect general quantum lower bound should be O(n). The best known lower bounds for 
specific properties, such as the f2(ra) lower bound for Connectivity implied by Ambainis' 
||] general technique, do not seem to be tight. It would be interesting to improve both 
the general and the specific lower bounds. Probably this will require new techniques other 
than that of Ambainis ||] . 

Space-time tradeoffs for sorting and related problems have been studied for the classical 
case. A Time • Space lower bound of Q(n 2 ) is proved for the comparison-based sorting 
by Borodin et al. @, and for the R-way branching program by Beame [||. Formulations 
and results on the quantum time-space tradeoffs for sorting and other problems such as 
Element Distinctness would be interesting. 



5 Acknowledgment 

The author would like to thank Andy Yao for discussions, Dieter van Melkebeek, 
Daniel Wang, and especially Sanjeev Arora, for their precious comments and suggestions. 

References 

[1] Proceedings of the Twenty- Eighth Annual ACM Symposium on the Theory of Com- 
puting, Philadelphia, Pennsylvania, May 1996. 

[2] A. Ambainis. A better lower bound for quantum algorithms searching an ordered 
list. In 40th Symposium on Foundations of Computer Science (FOCS), pages 352- 
357, New York, NY, USA, October 1999. IEEE Computer Society. 



[3] A. Ambainis. Quantum lower bounds by quantum arguments. In Proceedings of the 
Thirty-second Annual ACM Symposium on the Theory of Computing, pages 636-643, 
Portland, Oregon, May 2000. 

[4] R. Beals, H. Buhrman, R. Cleve, M. Mosca, and R. de Wolf. Quantum lower bounds 
by polynomials. In 39th Annual Symposium on Foundations of Computer Science, 
pages 352-361, Los Alamitos, CA, November 1998. IEEE. 

[5] Paul Beame. A general sequential time-space tradeoff for finding unique elements. 
SIAM J. Comput., 20(2):270-277, 1991. 

[6] Charles H. Bennett, Ethan Bernstein, Gilles Brassard, and Umesh Vazirani. Strengths 
and weaknesses of quantum computing. SIAM Journal on Computing, 26(5): 1510- 
1523, October 1997. 

[7] Allan Borodin, Michael J. Fischer, David G. Kirkpatrick, Nancy A. Lynch, and Martin 
Tompa. A time-space tradeoff for sorting on nonoblivious machines. J. Comput. 
System Sci., 22(3):351-364, 1981. Special issue dedicated to Michael Machtey. 

[8] M. Boyer, G. Brassard, P. Hoyer, and A. Tap. Tight bounds on quantum searching. 
Fortschritte der Physik, 46(4-5), 1998. 

[9] Harry Buhrman, Christoph Durr, Mark Heiligman, Peter H0yer, Frederic Magniez, 
Miklos Santha, and Ronald de Wolf. Quantum algorithm for element distinctness. 
Preliminary version: quant-ph/00070f6| , 2000. 



[10] M.-D. Choi. Tricks or treats with the Hilbert matrix. Amer. Math. Monthly, 
90(5):301-312, 1983. 

[11] Christoph Durr and Perter H0yer. A quantum algorithm for finding the minimum. 



Preliminary version: quant-ph/9607014 , 1996. 



[12] Edward Farhi, Jeffrey Goldstone, Sam Gutmann, and Michael Sipser. Invariant 



quantum algorithms for insertion into an ordered list. Preliminary version: quant 



ph/9901059| , 1999 



[13] Dima Grigoriev, Marek Karpinski, Friedhelm Meyer auf der Heide, and Roman 
Smolensky. A lower bound for randomized algebraic decision trees. In ACM Q, 
pages 612-619. 

[14] Lov K. Grover. A fast quantum mechanical algorithm for database search. In ACM 
0, pages 212-219. 



10 



[15] P. H0yer and J. Neerbek. Bounds on quantum ordered searching. Preliminary version: 
|quant-ph/0009032| , 2000. 



[16] Peter W. Shor. Polynomial-time algorithms for prime factorization and discrete log- 
arithms on a quantum computer. SI AM Journal on Computing, 26(5): 1484-1509, 
October 1997. 

[17] Andrew Yao. Personal communication, 2000. 



11 



